Image processing system with ease of operation

ABSTRACT

The position and orientation at a time of shooting by a shooting unit of a portable terminal is transmitted to an information processing apparatus. Based on the transmitted position and orientation of the portable terminal and the stored position of an image processing apparatus, the information processing apparatus extracts an image processing apparatus from the shot image and transmits information about the extracted image processing apparatus to the portable terminal. The portable terminal combines the shot image with an option for selecting a function available in the image processing apparatus and displays the combined image on a display unit, based on the information transmitted from the information processing apparatus. When selection of a function is accepted, a screen for operating the selected function is displayed on the display unit of the portable terminal.

This application is based on Japanese Patent Application No. 2010-230358filed with the Japan Patent Office on Oct. 13, 2010, the entire contentof which is hereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing system, a controlmethod, an image processing apparatus, a portable terminal, and aninformation processing apparatus, and more particularly to an imageprocessing system in which an image processing apparatus is operated bya portable terminal, a control method, the image processing apparatus,the portable terminal, and an information processing apparatus.

2. Description of the Related Art

Image processing apparatuses such as copiers, printers, and MFPs(Multi-Functional Peripherals) including those functions are often usedin office environments. Many users have opportunities to use thoseapparatuses.

On the other hand, with the recent widespread use of portable terminals,users carry portable equipment such as mobile phones having a functionof connecting to the Internet, a camera function, and a positiondetection function and are familiar themselves with using them. Then, asdisclosed in, for example, Japanese Laid-Open Patent Publication Nos.2006-351024 and 2006-091390, some portable information terminals obtaininformation stored beforehand in association with positional informationfrom a server and combine the information with the captured image,thereby allowing users to view information such as facility usage statusor reservation information based on the captured image.

As such image processing apparatuses grow more sophisticated, theoperations for users to give operation instructions become complicated.Therefore, the users who use the apparatuses less frequently or theusers who use different kinds of apparatuses find it difficult torecognize available functions or find it difficult to use theapparatuses due to the complicated operations.

Then, in light of the widespread use of portable terminals as describedabove, users may desire to use portable terminals familiar to them evenwhen operating image processing apparatuses.

SUMMARY OF THE INVENTION

The present invention is made to solve such a problem. An object of thepresent invention is to provide an image processing system in which animage processing apparatus can be operated easily using a portableterminal, a control method, the image processing apparatus, the portableterminal, and an information processing apparatus.

In order to achieve the object, in accordance with an aspect of thepresent invention, an image processing system includes a portableterminal, an image processing apparatus including a controller, and aninformation processing apparatus. The portable terminal includes ashooting unit, an obtaining unit for obtaining positional informationand orientation information of the portable terminal, a display unit,and an input unit for inputting an instruction on an operation screendisplayed on the display unit. The information processing apparatusincludes a storage unit for storing, as information about an imageprocessing apparatus, positional information of the image processingapparatus, functional information indicating an installed availablefunction, and communication information for communicating with theportable terminal. The portable terminal transmits positionalinformation and orientation information at a time of shooting by theshooting unit to the information processing apparatus. The informationprocessing apparatus detects an image processing apparatus included inan image shot by the shooting unit of the portable terminal, based onthe positional information and orientation information at a time ofshooting at the portable terminal, and transmits information about thedetected image processing apparatus to the portable terminal. Theportable terminal further includes a controller for combining the imageshot by the shooting unit with an option for selecting an availablefunction in the image processing apparatus and displaying the combinedimage on the display unit, and for accepting selection of the functionby the input unit.

Preferably, when accepting selection of the function, the controller ofthe portable terminal transmits a signal specifying the function to theimage processing apparatus. The controller of the image processingapparatus transmits information for displaying a screen for operatingthe function to the portable terminal, based on the signal specifyingthe function. The controller of the portable terminal allows the displayunit to display a screen for operating the selected function based onthe information.

More preferably, the image processing apparatus further includes adisplay unit for displaying an operation screen for accepting operationinput, and the controller of the image processing apparatus transmitsinformation for an operation screen of the function to be displayed onthe display unit of the image processing apparatus, to the portableterminal, based on the signal specifying the selected function from theportable terminal.

Preferably, when accepting an instruction on the operation screen by theinput unit, the controller of the portable terminal transmits a signalrepresenting the instruction to the image processing apparatus. Thecontroller of the image processing apparatus executes image processingcorresponding to the signal.

Preferably, the image processing apparatus further includes a storageunit for storing, as information about the image processing apparatus,positional information of the image processing apparatus, functionalinformation indicating an available function installed in the imageprocessing apparatus, and communication information for communicatingwith the portable terminal, a first communication unit for communicatingwith the information processing apparatus, and a second communicationunit for communicating with the portable terminal. When detecting achange of the information about the image processing apparatus, thecontroller of the image processing apparatus executes a process oftransmitting the information about the image processing apparatus to theinformation processing apparatus.

In accordance with another aspect of the present invention, provided isa control method for an image processing system including a portableterminal having a shooting unit and a display unit, an image processingapparatus, and an information processing apparatus. The informationprocessing apparatus stores, as information about the image processingapparatus, positional information of the image processing apparatus,functional information indicating an installed available function, andcommunication information for communicating with the portable terminal.The control method includes the steps of: causing the portable terminalto transmit positional information and orientation information at a timeof shooting by the shooting unit of the portable terminal to theinformation processing apparatus; causing the information processingapparatus to extract an image processing apparatus included in an imageshot by the shooting unit of the portable terminal, based on thepositional information and orientation information transmitted from theportable terminal and the positional information included in theinformation about the image processing apparatus, and to transmitinformation about the extracted image processing apparatus to theportable terminal; causing the portable terminal to combine the imageshot by the shooting unit with an option for selecting an availablefunction in the image processing apparatus and display the combinedimage on the display unit, based on the information about the imageprocessing apparatus transmitted from the information processingapparatus; when selection of the function is accepted, causing theportable terminal to display a screen for operating the selectedfunction on the display unit; when an instruction on the screen foroperating is accepted, causing the portable terminal to transmit asignal representing the instruction to the image processing apparatus;and causing the image processing apparatus to execute correspondingimage processing based on the signal.

Preferably, the control method further includes the steps of: whenselection of the function is accepted, causing the portable terminal totransmit a signal specifying the selected function to the imageprocessing apparatus; and causing the image processing apparatus totransmit information for displaying a screen for operating the functionto the portable terminal, based on the signal specifying the functionthat is transmitted from the portable terminal. In the step of causingthe portable terminal to display a screen for operating the selectedfunction on the display unit, the portable terminal displays the screenfor operating based on the information for displaying a screen foroperating the function that is transmitted from the image processingapparatus.

In accordance with a further aspect of the present invention, a portableterminal includes a shooting unit, an obtaining unit for obtainingpositional information and orientation information of the portableterminal, a display unit, an input unit for inputting an instruction onan operation screen displayed on the display unit, and a controller. Thecontroller executes a process of transmitting positional information andorientation information at a time of shooting by the shooting unit to aninformation processing apparatus, a process of combining an image shotby the shooting unit with an option for selecting an available functionin an image processing apparatus, and displaying the combined image onthe display unit, based on information about the image processingapparatus received from the information processing apparatus, a processof accepting selection of the function by the input unit and thendisplaying a screen for operating the selected function on the displayunit, and a process of accepting an instruction on the screen foroperating by the input unit and then transmitting a signal representingthe instruction to the image processing apparatus.

Preferably, when accepting selection of the function by the input unit,the controller transmits a signal specifying the function to the imageprocessing apparatus and allows the display unit to display the screenfor operating based on information for displaying the screen foroperating the function that is received from the image processingapparatus in response to the signal.

In accordance with yet another aspect of the present invention, aninformation processing apparatus includes: a storage unit for storing,as information about an image processing apparatus, positionalinformation of the image processing apparatus, functional informationindicating an installed available function, and communicationinformation for communicating with a portable terminal; a communicationunit for communicating with the portable terminal; and a controller.When receiving, from the portable terminal, positional information andorientation information at a time of shooting by a shooting unit of theportable terminal, the controller executes a process of extracting animage processing apparatus included in an image shot by the shootingunit of the portable terminal, based on the positional information andorientation information and the positional information included in theinformation about the image processing apparatus, and transmittinginformation about the extracted image processing apparatus to theportable terminal.

In accordance with a still further aspect of the present invention, animage processing apparatus includes: a first communication unit forcommunicating with a portable terminal; and a controller. Based on asignal specifying a function of image processing received from theportable terminal, the controller executes a process of transmittinginformation for displaying a screen for operating the function to theportable terminal.

Preferably, the image processing apparatus further includes: a storageunit for storing, as information about the image processing apparatus,positional information of the image processing apparatus, functionalinformation indicating an available function installed in the imageprocessing apparatus, and communication information for communicatingwith the portable terminal; and a second communication unit forcommunicating with an information processing apparatus. When detecting achange of the information about the image processing apparatus, thecontroller further executes a process of transmitting the informationabout the image processing apparatus to the information processingapparatus.

In accordance with another aspect of the present invention, anon-transitory computer-readable recording medium is encoded with acontrol program for causing a portable terminal including a shootingunit and a display unit to execute processing. The control programcauses the portable terminal to execute the steps of: transmittingpositional information and orientation information at a time of shootingby the shooting unit to an information processing apparatus; combiningan image shot by the shooting unit with an option for selecting anavailable function in the image processing apparatus and displaying thecombined image on the display unit, based on information about an imageprocessing apparatus that is received from the information processingapparatus; when selection of the function is accepted, displaying ascreen for operating the selected function on the display unit; and whenan instruction on the screen for operating is accepted, transmitting asignal representing the instruction to the image processing apparatus.

Preferably, the step of displaying a screen for operating the selectedfunction on the display unit includes the steps of: when selection ofthe function is accepted, transmitting a signal specifying the functionto the image processing apparatus; and receiving information fordisplaying a screen for operating the function from the image processingapparatus in response to the signal. The screen for operating isdisplayed on the display unit based on the information for displaying ascreen for operating the function from the image processing apparatus.

In accordance with yet another aspect of the present invention, anon-transitory computer-readable recording medium is encoded with acontrol program for causing an information processing apparatus toexecute processing. The information processing apparatus stores, asinformation about an image processing apparatus, positional informationof the image processing apparatus, functional information indicating aninstalled available function, and communication information forcommunicating with a portable terminal. The control program causes theinformation processing apparatus to execute the steps of: receiving,from the portable terminal, positional information and orientationinformation at a time of shooting by a shooting unit of the portableterminal; extracting an image processing apparatus included in an imageshot by the shooting unit of the portable terminal, based on thepositional information and orientation information and the positionalinformation included in the information about an image processingapparatus; and transmitting information about the extracted imageprocessing apparatus to the portable terminal.

In accordance with yet another aspect of the present invention, anon-transitory computer-readable recording medium is encoded with acontrol program for causing an image processing apparatus to executeprocessing. The control program causes the image processing apparatus toexecute the steps of: based on a signal specifying a function that isreceived from a portable terminal, transmitting information fordisplaying a screen for operating the function to the portable terminal;and executing image processing corresponding to an instruction aboutimage processing from the portable terminal in accordance with thescreen.

In accordance with yet another aspect of the present invention, anon-transitory computer-readable recording medium is encoded with acontrol program for causing an image processing apparatus to executeprocessing. The image processing apparatus stores, as information aboutthe image processing apparatus, positional information of the imageprocessing apparatus, functional information indicating an availablefunction installed in the image processing apparatus, and communicationinformation for communicating with a portable terminal. The controlprogram causes the image processing apparatus to execute the steps of:detecting a change of the information about the image processingapparatus; and transmitting the information about the image processingapparatus to an information processing apparatus when the change isdetected.

The foregoing and other objects, features, aspects and advantages of thepresent invention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing a specific example of a configuration of animage processing system according to an embodiment.

FIG. 2 is a diagram for illustrating overall operations in the imageprocessing system according to the embodiment.

FIG. 3 is a diagram showing a specific example of a hardwareconfiguration of an MFP (Multi-Functional Peripheral) included in theimage processing system according to the embodiment.

FIG. 4 is a diagram showing a specific example of a configuration of anoperation panel of the MFP.

FIG. 5 is a diagram showing a specific example of a hardwareconfiguration of a portable terminal included in the image processingsystem according to the embodiment.

FIG. 6 is a diagram showing a specific example of a hardwareconfiguration of a server included in the image processing systemaccording to the embodiment.

FIG. 7 is a block diagram showing a specific example of a functionalconfiguration of the MFP.

FIG. 8 is a block diagram showing a specific example of a functionalconfiguration of the portable terminal.

FIG. 9 is a block diagram showing a specific example of a functionalconfiguration of the server.

FIG. 10 is a flowchart showing a specific example of an operation in theMFP performing an MFP information registration operation.

FIG. 11 is a diagram showing a specific example of an MFP list stored inthe server.

FIG. 12 is a sequence diagram illustrating a flow of an operation foroperating the MFP.

FIG. 13 is a flowchart illustrating an operation in the portableterminal for displaying a tag superimposed on a shot image.

FIG. 14 is a flowchart illustrating an operation in the portableterminal in a case where a box function is selected as a function to beoperated.

FIG. 15 is a flowchart illustrating an operation in the portableterminal in a case where a scan function is selected as a function to beoperated.

FIG. 16 is a block diagram showing a specific example of a functionalconfiguration of the MFP according to a modified embodiment.

FIG. 17 is a sequence diagram illustrating a flow of an operation foroperating the MFP in the image processing system according to themodified embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following, an embodiment of the present invention will bedescribed with reference to the figures. In the following description,the same parts and components are denoted with the same referencenumerals. Their names and functions are also the same.

<System Configuration>

FIG. 1 is a diagram showing a specific example of a configuration of animage processing system according to an embodiment.

Referring to FIG. 1, the image processing system according to thepresent embodiment includes an MFP (Multi-Functional Peripheral) 100serving as an image processing apparatus, a portable terminal 200, and aserver 300.

The image processing apparatus is not limited to an MFP and may be aprinter, a facsimile machine, a copier, or any other similar devicehaving at least one or more image processing functions. MFP 100 is animage processing apparatus that combines these functions.

Portable terminal 200 is, for example, a mobile phone or any otherdevice at least having a camera function, an instruction input function,and a communication function.

The server is a general personal computer or any other similar device.

MFP 100 and potable terminal 200 can communicate with each other andexchange information with each other. Any communication system may beemployed in the communication between MFP 100 and portable terminal 200as long as it is wireless communication. In the example below, wirelesscommunication using Bluetooth® is employed. However, any othercommunication such as infrared communication or short-distance wirelesscommunication may be employed.

MFP 100 and server 300 can also communicate with each other and exchangeinformation with each other. The communication between MFP 100 andserver 300 is either wired or wireless, and any communication system maybe employed. Since it is assumed that the image processing systemaccording to the present embodiment is used in an office environment,MFP 100 and server 300 are connected to a wired or wireless LAN (LocalArea Network) and exchange information through the network, by way ofexample.

Portable terminal 200 and server 300 can also communicate with eachother and exchange information with each other. Any communication systemmay be employed in the communication between portable terminal 200 andserver 300 as long as it is wireless communication. In the examplebelow, wireless communication using a telephone network is employed.However, infrared communication or short-distance wireless communicationmay be employed. In the case where portable terminal 200 and server 300are connected to a wireless LAN, information may be exchanged over thenetwork.

In the following description, different communication systems areemployed, specifically, wireless communication using Bluetooth® betweenMFP 100 and portable terminal 200, communication via a LAN between MFP100 and server 300, and wireless communication using a telephone networkbetween portable terminal 200 and server 300. However, the samecommunication system such as communication via a LAN may be employed ineach communication.

Although the image processing system in FIG. 1 is configured to includeone MFP, one portable terminal, and one server, it may at least includemore than one MFP and more than one potable terminal.

<Overall Operations>

The overall operations in the image processing system according to thepresent embodiment mainly include an MFP information registrationoperation and an operation for operating the MFP.

Here, “MFP information” refers to information about the MFP included inthe image processing system, which is registered in server 300, andincludes positional information which is information for specifying theposition of MFP 100, communication information which is information forcommunication, and functional information which is information forspecifying the installed available function. Specific examples thereofwill be described later. Plural pieces of MFP information stored inserver 300 may also referred to as an “MFP list” in the followingdescription.

The MFP information registration operation is performed prior to theoperation for operating the MFP and refers to an operation ofregistering information of MFP 100 in server 300 at a prescribed timingor updating the information of MFP 100 stored in server 300 with thelatest information.

The operation for operating the MFP refers to an operation of performingan operation using portable terminal 200 to allow MFP 100 to executeimage processing using a function installed in MFP 100. FIG. 2 is adiagram for illustrating the overall operations in the image processingsystem according to the embodiment. The operation for operating MFP 100in the image processing system will be described using FIG. 2.

Referring to FIG. 2, a user carrying portable terminal 200 pointsportable terminal 200 at MFP 100 serving as an operation target to shootMFP 100 (FIG. 2 (1)). Then, the shot image of MFP 100 serving as anoperation target appears on a display screen of portable terminal 200.The functions available in MFP 100 are selectably displayed in the formof tags superimposed on the shot image (FIG. 2 (2)). The user selects atag representing a function to use, from those tags.

It is noted that the “tag” here refers to an option displayed on thetouch panel, and is labeled with a function to be operated, asillustrated in FIG. 2 (2), and displayed in the vicinity of the image ofMFP 100 as an operation target so as to be superimposed on the originalimage. Touching the tag designates to perform the operationcorresponding to the function.

For example, when the user selects (touches) a tag indicating a boxfunction which is a function of processing image data stored in astorage area associated with the user (“touch” in FIG. 2 (2)), thescreen display of portable terminal 200 switches to a screen foroperating the box function of MFP 100 (FIG. 2 (3)). When image data tobe processed is selected on the screen (“touch” in FIG. 2 (3)), thescreen display of portable terminal 200 further switches to a screen forselecting a method of processing the image data (FIG. 2 (4)). Then, whena processing method is selected on the screen (“touch” in FIG. 2 (4)),image processing based on the operation is executed in MFP 100.

The configuration of each device for performing these operations will bedescribed below.

<Configuration of MFP>

FIG. 3 shows a specific example of a hardware configuration of MFP 100.

Referring to FIG. 3, MFP 100 includes a CPU (Central Processing Unit) 10as an arithmetic unit for controlling MFP 100 as a whole, a ROM (ReadOnly Memory) 11 for storing a program executed in CPU 10, a RAM (RandomAccess Memory) 12 functioning as a work area for executing a program inCPU 10, a scanner 13 for optically scanning a document placed on anot-shown platen to obtain image data, a printer 14 for fixing imagedata on print paper, an operation panel 15 including a touch panel fordisplaying information and accepting an operation input to MFP 100, amemory 16 for storing image data, a communication controller 17 forcontrolling wireless communication using Bluetooth®, and a networkcontroller 18 for controlling communication via a LAN.

FIG. 4 is a diagram showing a specific example of a configuration ofoperation panel 15.

Referring to FIG. 4, operation panel 15 includes a touch panel 51 andoperation keys 52. Touch panel 51, configured to include a display suchas a liquid crystal display and a position designating device such as anoptical touch panel or a capacitive touch panel, displays an operationscreen and specifies a designated position on the operation screen. CPU10 allows touch panel 51 to display an operation screen, based on datafor allowing image display that is stored beforehand.

Operation keys 52 include a ten-key pad 521, a start key 522 fordesignating start of a job, and mode select keys 523 for selecting amode to be activated. Mode select keys 523 each include an indicatorlamp 523A containing, for example, an LED (Light Emitting Diode) toindicate being selected.

An operation signal indicating a designated position (touched position)specified on touch panel 51 or a pressed key is input to CPU 10. CPU 10then specifies an operation content based on the pressed key, or thedisplayed operation screen and the designated position, and executes aprocess based on the operation content.

<Configuration of Portable Terminal>

FIG. 5 is a diagram showing a specific example of a hardwareconfiguration of portable terminal 200.

Referring to FIG. 5, portable terminal 200 includes a CPU 20 as anarithmetic unit for controlling portable terminal 200 as a whole, a ROM21 for storing a program executed in CPU 20, a RAM 22 functioning as awork area for executing a program in CPU 20, an electronic compass 23including a magnetic sensor for detecting an orientation of potableterminal 200, a GPS (Global Positioning System) controller 24 receivinga GPS signal or a positional signal from a base station for obtainingpositional information of portable terminal 200, an operation panel 25including a touch panel for displaying information and accepting anoperation input to portable terminal 200, a camera 26, a firstcommunication controller 27 for controlling communication via atelephone network through communication with a not-shown base station, asecond communication controller 28 for controlling wirelesscommunication using Bluetooth®, and a memory 29 for storing telephonebook data and the like.

Operation panel 25 may be configured similar to operation panel 15 ofMFP 100. More specifically, it includes, for example, a touch panelformed of a display such as a liquid crystal display and a positiondesignating device such as an optical touch panel or a capacitive touchpanel, and operation keys.

CPU 20 allows the touch panel to display an operation screen based ondata for allowing screen display that is stored beforehand. A designatedposition on the operation screen is specified on the touch panel, and anoperation signal indicating the designated position is input to CPU 20.An operation signal indicating the pressed key is also input to CPU 20.CPU 20 specifies an operation content based on the pressed key, or thedisplayed operation screen and the designated position, and executes aprocess based on the operation content.

Electronic compass 23 and GPS controller 24 output a signal to CPU 20 toindicate the obtained orientation or positional information of potableterminal 200.

<Configuration of Server>

FIG. 6 is a diagram showing a specific example of a hardwareconfiguration of server 300.

Referring to FIG. 6, server 300 is formed, for example, of a generalcomputer as described above. By way of example, server 300 includes aCPU 30 as an arithmetic unit for controlling server 300 as a whole, aROM 31 for storing a program executed in CPU 30, a RAM 32 functioning asa work area for executing a program in CPU 30, an HD (Hard Disk) 33 forstoring MFP information and the like, a communication controller 34 forcontrolling communication via a telephone network, and a networkcontroller 35 for controlling communication via a LAN.

<Functional Configuration>

The functional configuration of each device for implementing theoperation as illustrated in the overall operations in the imageprocessing system will be described.

FIG. 7 is a block diagram showing a specific example of a functionalconfiguration of MFP 100. Each function shown in FIG. 7 is a functionmainly formed in CPU 10 when CPU 10 reads out a program stored in ROM 11and executes the program on RAM 12. However, at least part of thefunctions may be formed by the hardware configuration shown in FIG. 3.

Referring to FIG. 7, as functions for implementing the operations asdescribed above, MFP 100 includes an instruction input unit 101 foraccepting an instruction input from operation panel 15 or any otherdevice, a positional information input unit 102 for accepting input ofits own positional information from operation panel 15 or from the GPSfunction not shown in FIG. 3, if any, an address input unit 103 foraccepting input of a LAN address and an address in wirelesscommunication using Bluetooth®, a positional information storage unit104 for storing the positional information accepted by positionalinformation input unit 102, a communication information storage unit 105for storing the address accepted by address input unit 103, ascommunication information, a function management unit 106 for managingthe functions of MFP 100 and allowing each function to execute anoperation, a detection unit 107 for detecting a change of positionalinformation, communication information, and executable functions in MFP100, an update unit 108 for transmitting the positional information,communication information, and functional information of MFP 100 as MFPinformation to server 300 to register or update the MFP information inthe MFP list in server 300, a screen transmission unit 109 fortransmitting required operation screen data among operation screens datastored beforehand, in response to a request from portable terminal 200as described later, and an instruction specifying unit 110 forspecifying the content of an instruction from portable terminal 200.

The method of specifying an instruction content in instructionspecifying unit 110 is similar to the method of specifying theinstruction content in the case where a touch instruction is accepted inaccordance with an operation screen on its own operation panel 15. Morespecifically, instruction specifying unit 110 specifies where in theoperation screen the designated position is located, based on a signalfor specifying the designated position from portable terminal 200 andthe transmitted screen data, and determines the instruction contentcorresponding to the specified position with reference to thecorrespondence stored beforehand between the position on the screen andthe instruction content.

FIG. 8 is a block diagram showing a specific example of a functionalconfiguration of portable terminal 200. Each function shown in FIG. 8 isa function mainly formed in CPU 20 when CPU 20 reads out a programstored in ROM 21 and executes the program on RAM 22. However, at leastpart of the functions may be formed by the hardware configuration shownin FIG. 5.

Referring to FIG. 8, as functions for implementing the operations asdescribed above, portable terminal 200 includes an instruction inputunit 201 for accepting an instruction input from operation panel 25, aposition obtaining unit 202 for obtaining positional information ofportable terminal 200 in response to a shooting instruction fromoperation panel 25, an orientation obtaining unit 203 for obtaining anorientation of portable terminal 200 in response to a shootinginstruction from operation panel 25, an image obtaining unit 204 forobtaining image data captured by shooting by camera 26 in response to ashooting instruction from operation panel 25, a server request unit 205for requesting the MFP information from server 300 together with thepositional information and orientation information obtained in responseto a shooting instruction from operation panel 25, an MFP informationobtaining unit 206 for obtaining the MFP information of MFP 100 servingas an operation target from server 300 in response to the request, ageneration unit 207 for generating screen data by combining selectabletags with image data based on the image data obtained by shooting andthe MFP information, a display processing unit 208 for executing aprocess of displaying screen data on operation panel 25, a transmissionunit 210 for transmitting, to MFP 100, an operation signal specifying adesignated position on the display screen based on the screen data, anda screen obtaining unit 209 for obtaining screen data transmitted fromMFP 100 in response to the signal.

Since positional obtaining unit 202 and orientation obtaining unit 203obtain positional information and orientation information, respectively,in response to a shooting instruction from operation panel 25, theinformation thereof can serve as information of a shooting position andinformation of a shooting direction, respectively. Then, in thedescription below, the positional information and orientationinformation transmitted from portable terminal 200 to server 300 inaccordance with the program are also referred to as shooting positioninformation and shooting direction information, respectively.

FIG. 9 is a block diagram showing a specific example of a functionalconfiguration of server 300. Each function shown in FIG. 9 is a functionmainly formed in CPU 30 when CPU 30 reads out a program stored in ROM 31and executes the program on RAM 32. However, at least part of thefunctions may be formed by the hardware configuration shown in FIG. 6.

Referring to FIG. 9, as functions for implementing the operations asdescribed above, server 300 includes an MFP information input unit 301for accepting input of MFP information from MFP 100, an MFP informationstorage unit 302 for storing or updating the MFP information input inthe MFP list in a prescribed area of HD 33, a portable information inputunit 303 for accepting input of a shooting position and a shootingdirection together with a request for MFP information from portableterminal 200, a search unit 304 for searching for the MFP present in theshot image of portable terminal 200 based on the shooting position andthe shooting direction of portable terminal 200, and a transmission unit305 for transmitting the retrieved MFP information of the MFP 100 toportable terminal 200.

<Operation Flow for Registration of MFP Information>

FIG. 10 is a flowchart showing a specific example of an operation in MFP100 performing the MFP information registration operation. The operationshown in the flowchart in FIG. 10 is implemented when CPU 10 reads out aprogram stored in ROM 11 and executes the program on RAM 12.

Here, the registration of MFP information includes “manual registration”performed by user's operation and “automatic registration” automaticallyperformed without user's operation at a predetermined prescribed timing.Which registration method is employed in registering MFP information ispreset in MFP 100, for example, by an administrator. CPU 10 stores thesetting.

Referring to FIG. 10, when the “manual registration” is set (YES in stepS101), in step S103, CPU 10 executes a predetermined MFP informationregistration operation in accordance with an operation signal fromoperation panel 15. Specifically, CPU 10 accepts input of positionalinformation, communication information, and functional information asMFP information in accordance with an operation signal from operationpanel 15 and stores the information. Then, the information istransmitted as MFP information to server 300.

On the other hand, when the “automatic registration” is set (NO in stepS101), CPU 10 detects positional information, communication information,functional information at the respective prescribed timings. Theprescribed timings are, for example, the timing at which MFP 100 isinstalled, the timing at which network communication is established, orprescribed time intervals. At the instant when the positionalinformation, communication information, or functional information isdetected (YES in step S105), CPU 10 compares the detected informationwith the stored information and determines whether there is a change. Ifa change is detected (YES in step S107), in step S109, CPU 10 executes apredetermined MFP information registration operation. Specifically, CPU10 updates the information detected being changed, of the storedpositional information, communication information, and functionalinformation, with the latest information and thereafter transmits theMFP information to server 300. Here, only the information that haschanged in the MFP information may be transmitted, or the entire MFPinformation may be transmitted.

Upon receiving the MFP information from MFP 100, server 300 updates theMFP list stored in a prescribed area in HD 33. Specifically, when theMFP information of MFP 100 is not registered in the MFP list, server 300newly registers the received MFP information. When it has already beenregistered, server 300 updates the registered MFP information with thereceived MFP information.

Through this registration operation, the position, address, andinstalled available functions of each MFP included in the imageprocessing system are registered in server 300.

FIG. 11 is a diagram showing a specific example of the MFP list storedin server 300. Referring to FIG. 11, registered in the MFP list, foreach MFP included in the image processing system, are the latitude,longitude, and altitude as positional information, the IP address thatis an address for communicating with server 300 and the Bluetooth®address that is an address for communicating with portable terminal 200as communication information, and presence/absence of the box functionand the scan function each as functional information.

The MFP information is not limited to the one shown in FIG. 11. Forexample, an altitude may not be included in the positional information.In a case where any other communication system is employed, thecommunication information may be an address according to thecommunication system. The functional information may include thepresence/absence of any other function. In a case where userauthentication is performed as described later, whether to permit theuse of a function for each user may be included.

In the foregoing description, the MFP information is transmitted fromMFP 100 to server 300 for registration or update of the MFP list.Alternatively, in a case where server 300 has an input device, anadministrator of the image processing system, for example, may directlyinput MFP information to server 300. Alternatively, a not-showncommunication terminal connected to MFP 100 may transmit MFP informationto server 300. In this case, MFP 100 may not be able to communicate withserver 300 as long as the communication terminal connected to MFP 100can communicate with server 300.

<Operation Flow for Operation for Operating MFP>

FIG. 12 is a sequence diagram illustrating a flow of an operation foroperating the MFP. FIG. 12 shows a flow of processing in MFP 100 on theleft side, a flow of processing in portable terminal 200 at the middle,and a flow of processing in server 300 on the right side. Each operationis implemented when the CPU of each device reads out a program stored inthe ROM and executes the program on the RAM.

Referring to FIG. 12, in a state in which application for MFP operationis being activated in portable terminal 200 (step S1), the camera shootsa photo (step S3), and then the information that specifies a shootingposition and a shooting direction at portable terminal 200 istransmitted to server 300, whereby the corresponding MFP information isrequested (step S3-1).

Server 300 accepts the request from portable terminal 200 and searchesfor the MFP information of the MFP located in a prescribed range in theshooting direction from the shooting position from portable terminal200, with reference to each positional information in the stored MFPlist (step S5). Then, the corresponding MFP information is transmittedto portable terminal 200 (step S5-1). At portable terminal 200, theapplication combines the image data from camera 26 with tags forselecting the functions specified by the functional information includedin the received MFP information and displays the combined image onoperation panel 25 (step S7).

When the tag is selected (touched) on the image displayed on operationpanel 25 of portable terminal 200 (step S9), a request for a screen isgiven to MFP 100 together with the information that specifies thefunction corresponding to the selected tag (step S9-1).

MFP 100 transmits screen data for operating a process by the requestedfunction to the requestor portable terminal 200 (step S11). Here, thescreen data stored beforehand to be displayed on its own operation panel15 may be transmitted to portable terminal 200, or the correspondingscreen data stored for portable terminal 200 may be transmitted, or ifthe information specifying portable terminal 200 is transmitted togetherfrom the requestor portable terminal 200, the screen data storedbeforehand to be displayed on its own operation panel 15 may betransmitted after being subjected to resolution conversion based on theinformation of portable terminal 200.

Here, the screen data itself is transmitted from MFP 100 to portableterminal 200. However, in a case where the program activated in portableterminal 200 has a function of generating an operation screen, only theinformation necessary for the operation screen may be transmitted fromMFP 100 to portable terminal 200, and screen data may be generated inportable terminal 200 based on the transmitted information.

At portable terminal 200, an operation screen is displayed based on thetransmitted screen data. Then, when a touch operation is made on thescreen (step S13), information specifying the designated position istransmitted as an operation signal to MFP 100 (step S13-1). Theoperation signal transmitted here is, for example, an operation signalthat specifies the position designated on operation panel 25 by therelative position thereof to the displayed screen. As another example,in a case where the application running on portable terminal 200 has afunction of analyzing the screen data from MFP 100, the operationcontent corresponding to the position designated on operation panel 25may be specified, and an operation signal indicating the content may betransmitted to MFP 100.

MFP 100 specifies the operation content based on the screen datatransmitted to portable terminal 200 and the designated positionrepresented by the received operation signal (step S15). Here, when anadditional operation is required to perform the selected function, MFP100 transmits the screen data for the next operation screen inaccordance with the program for executing the selected function of itsown. In this case, the operation above in steps S11 to S15 is repeateduntil the function is executed.

Then, when all the operations necessary to execute the function arespecified, MFP 100 executes image processing using the function inaccordance with the operations (step S17).

In a case where the program activated in portable terminal 200 has afunction of generating a control signal, a control signal for MFP 100may be generated in accordance with the screen data and the positiondesignated on operation panel 25 and transmitted in place of theoperation signal in step S13-1. In this case, MFP 100 executes imageprocessing in accordance with the control signal from portable terminal200.

The operation in portable terminal 200 will be described in detail belowusing the flowcharts. FIG. 13, FIG. 14, and FIG. 15 are flowcharts eachillustrating an operation in portable terminal 200 performing anoperation for operating the MFP. FIG. 13 is a flowchart illustrating anoperation for displaying a tag superimposed on a shot image, FIG. 14 isa flowchart illustrating an operation in a case where a box function isselected as a function to be operated, and FIG. 15 is a flowchartillustrating an operation in a case where a scan function is selected asa function to be operated. The operations shown in the flowcharts inFIG. 13, FIG. 14, and FIG. 15 are implemented when CPU 20 reads out aprogram stored in ROM 21 corresponding to the application for operatingthe MFP and executes the read program on RAM 22.

Referring to FIG. 13, in a state in which CPU 20 is executing theapplication for operating the MFP (YES in step S201), and if camera 26is shooting a photo (YES in step S203), then in step S205, CPU 20transmits information representing a shooting position and a shootingdirection to server 300 and requests transmission of the MFP informationof the corresponding MFP.

When a response is received from server 300 (YES in step S207), and whenthe response is the MFP information (NO in step S209), CPU 20 executes aprocess for combining tags for selecting the functions specified by thefunctional information of the MFP information with the image dataobtained by shooting, and displaying the combined image.

Specifically, when the functional information shows that the boxfunction is available (YES in step S211), in step S213, CPU 20calculates the MFP display position in the image data obtained byshooting based on the positional information of the MFP included in theMFP information, and displays a tag for designating start of theoperation for the box function so as to be combined at the calculatedposition or in the vicinity thereof. In the example of the screen inFIG. 2 (2), image data of the tag labeled with “BOX” is storedbeforehand, and screen data is generated by combining the image data atthe calculated position and is displayed on operation panel 25.

When the functional information shows that the scan function isavailable (YES in step S215), in step S217, CPU 20 calculates the MFPdisplay position in the image data obtained by shooting based on thepositional information of the MFP included in the MFP information, anddisplays a tag for designating start of the operations for the scanfunction so as to be combined in the calculated position or in thevicinity thereof. In the example of the screen in FIG. 2 (2), image dataof the tag labeled with “scan” is stored beforehand, and image data isgenerated by combining the image data at the calculated position and isdisplayed on operation panel 25.

Next, referring to FIG. 14, when the tag representing the box functionis selected from the displayed tags (YES in step S301), in step S303,CPU 20 reads out the Bluetooth® address of MFP 100 from thecommunication information of the MFP information and initiatescommunication using Bluetooth® with MFP 100. Then, in step S305, thescreen data for operating the process by the box function is transmittedto MFP 100.

Upon receiving the corresponding screen data from MFP 100, in step S307,CPU 20 allows operation panel 25 to display an operation screen based onthe image data. Upon accepting the operation based on the operationscreen, that is, the touch operation on the operation screen (YES instep S309 and NO in step S311), in step S313, CPU 20 transmits a signalspecifying the designated position on the operation screen as anoperation signal to MFP 100.

The operation thereafter returns to step S305 described above, and thefollowing operation is repeated until the end of operation (YES in stepS311). More specifically, a signal specifying the designated position onthe operation screen is transmitted as an operation signal to MFP 100every time a touch operation on the operation screen is accepted, andthe next screen data is then transmitted from MFP 100. Accordingly, theoperation screens for inputting operations in the box function appearone after another, as depicted in FIG. 2 (3) (4), so that the operationsnecessary for the process by the box function are accepted on operationpanel 25 of portable terminal 200.

When the tag representing the scan function is selected from thedisplayed tags, CPU 20 also performs an operation similar to theoperation illustrated in FIG. 14. Specifically, referring to FIG. 15,when the tag representing the scan function is selected from thedisplayed tags (YES in step S401), in step S403, CPU 20 reads out theBluetooth® address of MFP 100 from the communication information of theMFP information and initiates communication using Bluetooth® with MFP100. Then, in step S405, screen data for operating the process by thescan function is transmitted to MFP 100.

Upon receiving the corresponding screen data from MFP 100, in step S407,CPU 20 allows operation panel 25 to display an operation screen based onthe image data. Upon accepting an operation based on the operationscreen, that is, a touch operation on the operation screen (YES in stepS409 and NO in step S411), in step S413, CPU 20 transmits a signalspecifying the designated position on the operation screen as anoperation signal to MFP 100.

The operation thereafter returns to step S405 described above, and thefollowing operation is repeated until the end of operation (YES in stepS411). More specifically, a signal specifying the designated position onthe operation screen is transmitted as an operation signal to MFP 100every time a touch operation on the operation screen is accepted, andthe next screen data is then transmitted from MFP 100. Accordingly, theoperation screens for inputting the operations in the box functionappear one after another in a similar manner as in FIG. 2 (3) (4), sothat the operations necessary for the process by the scan function areaccepted on operation panel 25 of portable terminal 200.

Effects of Embodiment

Through the operation as described above in the image processing systemaccording to the present embodiment, MFP 100 can be operated usingportable terminal 200 as described in the overall operations.

In the foregoing example, the box function and the scan function areillustrated as examples of functions of MFP 100. As the recent MFPs havebeen more sophisticated, even more functions are installed andavailable. In such a case, many options for selecting a function to beoperated from those functions as well as options for operation in thosefunctions are displayed on the operation screens appearing on operationpanel 15 of MFP 100. Therefore, such operation screens are difficult tooperate for the users unfamiliar with them. Moreover, since thefunctions installed in MFPs and the available functions vary among MFPs,the users unfamiliar with them may be unable to promptly determinewhether the desired function is available in the MFP to be operated.

In such a case, in the image processing system according to the presentembodiment, the user can activate the dedicated application in portableterminal 200 familiar to them and take a picture of the MFP, so that thefunctions available in the MFP are displayed as tags. Then, when theuser selects one from those tags, the operation screen for the functionto be operated appears on operation panel 25 of portable terminal 200.The user can operate MFP 100 through operation input on the screen.

Accordingly, the users can recognize the available functions at a glanceand, in addition, can operate the functions easily. In addition, evenwhen MFP 100 is located at a distance from the users, the users do nothave to move there and can operate MFP 100 with portable terminal 200they carry.

Modified Embodiment

In MFP 100, user authentication may be performed in using a function.Such a case will now be described as a modified embodiment.

FIG. 16 is a block diagram showing a specific example of a functionalconfiguration of MFP 100 according to the modified embodiment. Eachfunction shown in FIG. 16 is also a function mainly formed in CPU 10when CPU 10 reads out a program stored in ROM 11 and executes theprogram on RAM 12. However, at least part of the functions may be formedby the hardware configuration shown in FIG. 3.

Referring to FIG. 16, as functions for implementing the operationdescribed above, MFP 100 according to the modified embodiment furtherincludes, in addition to the functions shown in FIG. 7, a logininformation input unit 111 for accepting input of login information andan authentication unit 112 for performing user authentication.

In the modified embodiment, function management unit 106 stores theinstalled and available functions and stores information of userspermitted to use for each function, or user information that isinformation of the functions permitted to be used for each user.

FIG. 17 is a sequence diagram illustrating a flow of an operation foroperating the MFP in the image processing system according to themodified embodiment. The flow of the operation illustrated in FIG. 17differs from the flow of the operation shown in FIG. 12 in that anoperation for user authentication as illustrated in step S10 isadditionally performed.

Specifically, in the image processing system according to the modifiedembodiment, a function is selected at portable terminal 200 in step S9,and a request for a screen is given to MFP 100 together with theinformation that specifies the function corresponding to the tagselected in step S9-1. Then, MFP 100 determines whether the selectedfunction requires user authentication. Then, if user authentication isrequired, an operation for user authentication in step S10 is performed.

More specifically, if user authentication is required, in step S10-1,MFP 100 transmits screen data for inputting login information for use inuser authentication, in place of the requested screen data, to portableterminal 200. When input of login information is accepted in accordancewith the screen in step S10-2, then in step S10-3, MFP 100 refers to thestored user information and determines whether to permit the use of theselected function. If it is determined that the use is permitted, thatis, if user authentication is successful for the selected function, therequested screen data is transmitted to portable terminal 200 in stepS11.

In this manner, a function that requires user authentication, forexample, such as a box function, can also be provided with security andwith enhanced operability.

Although input of login information is accepted in this modifiedembodiment, MFP 100 may store the correspondence between the Bluetooth®address of portable terminal 200 and user information and may performuser authentication based on the address when portable terminal 200requests screen data from MFP 100 in step S9-1. Alternatively, in placeof user authentication in this manner, authentication may be performedusing a passkey (PIN code) in the communication using Bluetooth® betweenMFP 100 and portable terminal 200.

The present invention also provides a program for allowing MFP 100 asdescribed above to execute the foregoing operation, a program forallowing portable terminal 200 to execute the foregoing operation, and aprogram for allowing server 300 to execute the foregoing operation. Suchprograms may be stored in a computer-readable recording mediumaccompanying a computer, such as a flexible disk, a CD-ROM (CompactDisk-Read Only Memory), a ROM (Read Only Memory), a RAM (Random AccessMemory), and a memory card, and be provided as a program product.Alternatively, the programs may be stored in a recording medium such asa hard disk contained in a computer. The programs may be downloaded viaa network.

The program in accordance with the present invention may allow theprocess to be executed by invoking necessary modules, among programmodules provided as a part of Operating System (OS) of a computer, in aprescribed sequence at a prescribed timing. In this case, the modulesare not included in the program itself and the process is executed incooperation with OS. The program that does not include such modules mayalso be included in the program in accordance with the presentinvention.

Furthermore, the program in accordance with the present invention may beembedded in a part of another program. In this case, the modulesincluded in another program are not included in the program itself, andthe process is executed in cooperation with another program. Such aprogram embedded in another program may also be included in the programin accordance with the present invention.

The provided program product is installed in a program storage unit suchas a hard disk for execution. It is noted that the program productincludes the program itself and a recording medium encoded with theprogram.

Although the present invention has been described and illustrated indetail, it is clearly understood that the same is by way of illustrationand example only and is not to be taken by way of limitation, the scopeof the present invention being interpreted by the terms of the appendedclaims.

1. An image processing system comprising: a portable terminal; an imageprocessing apparatus including a controller; and an informationprocessing apparatus, said portable terminal including a shooting unit,an obtaining unit for obtaining positional information and orientationinformation of said portable terminal, a display unit, and an input unitfor inputting an instruction on an operation screen displayed on saiddisplay unit, said information processing apparatus including a storageunit for storing, as information about an image processing apparatus,positional information of said image processing apparatus, functionalinformation indicating an installed available function, andcommunication information for communicating with said portable terminal,wherein said portable terminal transmits positional information andorientation information at a time of shooting by said shooting unit tosaid information processing apparatus, and said information processingapparatus detects an image processing apparatus included in an imageshot by said shooting unit of said portable terminal, based on thepositional information and orientation information at a time of shootingat said portable terminal, and transmits information about said detectedimage processing apparatus to said portable terminal, said portableterminal further including a controller for combining said image shot bysaid shooting unit with an option for selecting an available function insaid image processing apparatus and displaying the combined image onsaid display unit, and for accepting selection of said function by saidinput unit.
 2. The image processing system according to claim 1, whereinwhen accepting selection of said function, said controller of saidportable terminal transmits a signal specifying said function to saidimage processing apparatus, said controller of said image processingapparatus transmits information for displaying a screen for operatingsaid function to said portable terminal, based on said signal specifyingsaid function, and said controller of said portable terminal allows saiddisplay unit to display a screen for operating said function based onsaid information.
 3. The image processing system according to claim 2,wherein said image processing apparatus further includes a display unitfor displaying an operation screen for accepting operation input, andsaid controller of said image processing apparatus transmits informationfor an operation screen of said function to be displayed on said displayunit of said image processing apparatus, to said portable terminal,based on said signal specifying said function.
 4. The image processingsystem according to claim 1, wherein when accepting an instruction onsaid operation screen by said input unit, said controller of saidportable terminal transmits a signal representing said instruction tosaid image processing apparatus, and said controller of said imageprocessing apparatus executes image processing corresponding to saidsignal.
 5. The image processing system according to claim 1, said imageprocessing apparatus further including a storage unit for storing, asinformation about said image processing apparatus, positionalinformation of said image processing apparatus, functional informationindicating an available function installed in said image processingapparatus, and communication information for communicating with saidportable terminal, a first communication unit for communicating withsaid information processing apparatus, and a second communication unitfor communicating with said portable terminal, wherein when detecting achange of said information about said image processing apparatus, saidcontroller of said image processing apparatus executes a process oftransmitting said information about said image processing apparatus tosaid information processing apparatus.
 6. A control method for an imageprocessing system including a portable terminal having a shooting unitand a display unit, an image processing apparatus, and an informationprocessing apparatus, wherein said information processing apparatusstores, as information about said image processing apparatus, positionalinformation of said image processing apparatus, functional informationindicating an installed available function, and communicationinformation for communicating with said portable terminal, said controlmethod comprising the steps of: causing said portable terminal totransmit positional information and orientation information at a time ofshooting by said shooting unit of said portable terminal to saidinformation processing apparatus; causing said information processingapparatus to extract an image processing apparatus included in an imageshot by said shooting unit of said portable terminal, based on saidpositional information and orientation information transmitted from saidportable terminal and the positional information included in saidinformation about said image processing apparatus, and to transmitinformation about said extracted image processing apparatus to saidportable terminal; causing said portable terminal to combine said imageshot by said shooting unit with an option for selecting an availablefunction in said image processing apparatus and display the combinedimage on said display unit, based on said information about said imageprocessing apparatus transmitted from said information processingapparatus; when selection of said function is accepted, causing saidportable terminal to display a screen for operating said selectedfunction on said display unit; when an instruction on said screen foroperating is accepted, causing said portable terminal to transmit asignal representing said instruction to said image processing apparatus;and causing said image processing apparatus to execute correspondingimage processing based on said signal.
 7. The control method accordingto claim 6, further comprising the steps of: when selection of saidfunction is accepted, causing said portable terminal to transmit asignal specifying said selected function to said image processingapparatus; and causing said image processing apparatus to transmitinformation for displaying a screen for operating said function to saidportable terminal, based on said signal specifying said function that istransmitted from said portable terminal, wherein in said step of causingsaid portable terminal to display a screen for operating said selectedfunction on said display unit, said portable terminal displays saidscreen for operating based on said information for displaying a screenfor operating said function that is transmitted from said imageprocessing apparatus.
 8. A portable terminal comprising: a shootingunit; an obtaining unit for obtaining positional information andorientation information of said portable terminal; a display unit; aninput unit for inputting an instruction on an operation screen displayedon said display unit; and a controller, wherein said controller executesa process of transmitting positional information and orientationinformation at a time of shooting by said shooting unit to aninformation processing apparatus, a process of combining an image shotby said shooting unit with an option for selecting an available functionin an image processing apparatus, and displaying the combined image onsaid display unit, based on information about said image processingapparatus that is received from said information processing apparatus, aprocess of accepting selection of said function by said input unit andthen displaying a screen for operating said selected function on saiddisplay unit, and a process of accepting an instruction on said screenfor operating by said input unit and then transmitting a signalrepresenting said instruction to said image processing apparatus.
 9. Theportable terminal according to claim 8, wherein when accepting selectionof said function by said input unit, said controller transmits a signalspecifying said selected function to said image processing apparatus andallows said display unit to display said screen for operating based oninformation for displaying said screen for operating the function thatis received from said image processing apparatus in response to saidsignal.
 10. An information processing apparatus comprising: a storageunit for storing, as information about an image processing apparatus,positional information of said image processing apparatus, functionalinformation indicating an installed available function, andcommunication information for communicating with a portable terminal; acommunication unit for communicating with said portable terminal; and acontroller, wherein when receiving, from said portable terminal,positional information and orientation information at a time of shootingby a shooting unit of said portable terminal, said controller executes aprocess of extracting an image processing apparatus included in an imageshot by said shooting unit of said portable terminal, based on saidpositional information and orientation information and the positionalinformation included in said information about said image processingapparatus, and transmitting information about said extracted imageprocessing apparatus to said portable terminal.
 11. An image processingapparatus comprising: a first communication unit for communicating witha portable terminal; and a controller, wherein, based on a signalspecifying a function of image processing received from said portableterminal, said controller executes a process of transmitting informationfor displaying a screen for operating said function to said portableterminal.
 12. The image processing apparatus according to claim 11,further comprising: a storage unit for storing, as information aboutsaid image processing apparatus, positional information of said imageprocessing apparatus, functional information indicating an availablefunction installed in said image processing apparatus, and communicationinformation for communicating with said portable terminal; and a secondcommunication unit for communicating with an information processingapparatus, wherein when detecting a change of said information aboutsaid image processing apparatus, said controller further executes aprocess of transmitting said information about said image processingapparatus to said information processing apparatus.
 13. A non-transitorycomputer-readable recording medium encoded with a control program forcausing a portable terminal including a shooting unit and a display unitto execute processing, said control program causing said portableterminal to execute the steps of: transmitting positional informationand orientation information at a time of shooting by said shooting unitto an information processing apparatus; combining an image shot by saidshooting unit with an option for selecting an available function in saidimage processing apparatus and displaying the combined image on saiddisplay unit, based on information about an image processing apparatusthat is received from said information processing apparatus; whenselection of said function is accepted, displaying a screen foroperating said selected function on said display unit; and when aninstruction on said screen for operating is accepted, transmitting asignal representing said instruction to said image processing apparatus.14. The non-transitory computer-readable recording medium according toclaim 13, wherein said step of displaying a screen for operating saidselected function on said display unit includes the steps of: whenselection of said function is accepted, transmitting a signal specifyingsaid function to said image processing apparatus; and receivinginformation for displaying a screen for operating said function fromsaid image processing apparatus in response to said signal, wherein saidscreen for operating is displayed on said display unit based on saidinformation for displaying a screen for operating said function fromsaid image processing apparatus.
 15. A non-transitory computer-readablerecording medium encoded with a control program for causing aninformation processing apparatus to execute processing, wherein saidinformation processing apparatus stores, as information about an imageprocessing apparatus, positional information of said image processingapparatus, functional information indicating an installed availablefunction, and communication information for communicating with aportable terminal, said control program causing said informationprocessing apparatus to execute the steps of: receiving, from saidportable terminal, positional information and orientation information ata time of shooting by a shooting unit of said portable terminal;extracting an image processing apparatus included in an image shot bysaid shooting unit of said portable terminal, based on said positionalinformation and orientation information and the positional informationincluded in said information about an image processing apparatus; andtransmitting information about said extracted image processing apparatusto said portable terminal.
 16. A non-transitory computer-readablerecording medium encoded with a control program for causing an imageprocessing apparatus to execute processing, said control program causingsaid image processing apparatus to execute the steps of: based on asignal specifying a function that is received from a portable terminal,transmitting information for displaying a screen for operating saidfunction to said portable terminal; and executing image processingcorresponding to an instruction about image processing from saidportable terminal in accordance with said screen.
 17. A non-transitorycomputer-readable recording medium encoded with a control program forcausing an image processing apparatus to execute processing, whereinsaid image processing apparatus stores, as information about said imageprocessing apparatus, positional information of said image processingapparatus, functional information indicating an available functioninstalled in said image processing apparatus, and communicationinformation for communicating with a portable terminal, said controlprogram causing said image processing apparatus to execute the steps of:detecting a change of said information about said image processingapparatus; and transmitting said information about said image processingapparatus to an information processing apparatus when said change isdetected.